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ABSTRACT 

While attending the December i2, 1984, Commission on 
Occupational Education Institutions (COEI) Delegate Assembly of the 
Southern Association of Colleges and Schools, 79 school personnel 
responded to a questionnaire to determine their attitudes toward 
accreditation standards. Measured were the following: respondents* 
perceptions of the priorities for review/revision of COEI standards 
and the importance of the standards in relation to institutional 
quality and (2) any differences in their perceptions related to 
demographic variaMcs describing the personnel. The study found three 
standards that should be given highest priority for review, and three 
standards that clearly ranked lowest ii. priority. This finding 
indicates that sufficient agreement exiFts among school 
representatives to use their perceptions as the basis for selecting 
clusters of standards for review and revision. Since only two or 
three standards can be addressed each year by the Committee on 
Standards, such information is important for the Committee. Th-e study 
also found that the assignment of review priority ranks by school 
personnel is related to on? demographic variable — type of school 
represented — and applies to less than half of the standards. The 
strategy used in this study offers a methodology that can be used by 
accreditation organizt-itions to ascertain the perceptions of their 
clientele regarding evaluative standards and criteria. The results of 
such assessments can provide an objective basis for determining the 
sequence in which the review and revision of standards or criteria 
might be addressed. (KC) 
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Int roduction 

To meet the increasing demand for quality assurance, school 
acc e'^itation agencies must ensure that their standards or criteria are 
appropriate and current for their client institutions. Several recent 
reports and articles identify needs and suggest demands from various sources 
to initiate educational reforms that rray have implications for school 
accreditation. Representative reports and articles include the following: 
the Twentieth Century Fund's report of the Task Force on Federal Elementary 
and Secondary Education Policy (1983), the Business-Higher Education Forum's 
r3port on America's Competitive Challenge (1983), the College Board's report 
on Academic Preparation for College (1983), the National Commission on 
Excellence in Education's report on a Nation at Risk (1983), the Southern 
Regional Education Board's report on Meeting the Needs for Quality-Action in 
the South (1983), the National Commission on Secondary Vocational 
Education's report on the Unfinished Agenda (1984), the article by Glenn 
Dumkr on "Accrediting: The Weak Link in Education Reform" (1986), and the 
report of the Council on Postsecondary Accreditation (19o6). 

The Commission on Occvpational Education Institutions (COEI), Southern 
Association of Colleges and Schools, has recognized throughout its existence 
since 1971 the need to review and revise its Standards continually because 
of changing technology in many programs offered by COEI-accredi ted 
\ocational-Lechnlcal schools. C0^~ has conducted periodic review and 
revision of its Standards over the years to keep them up to date and, 
thereby, enhance the credibility of accreditation by COEI. The recent 



demands for educational reform emphasize the requirement that accreditacion 
agencies address concerns regarding educational quality and institutional 
outcomes in their evaluative criteria. 

In recent years, COEI has intensified its efforts to engage* in 
syb**ematic review ana revision of its Standards with special attention 
focused on assessment of institutional quality and outcomes. A strategy was 
developed for implementation by the Committee on Standards of COEI to 
facilitate the continuous process of review and revision. The strategy 
consists of the following element3: (1) an annual review and revision of an 
average of the standards, (2) use of expert consultants and ad hoc committee 
members to assist the Committee on Standards (e.g., certified public 
accounrants, private institution business managers, and independent 
accredi Lation agency specialist to assist with revising the Standard o'* 
Financial Resources), and (3) periodic research studies to assist the 
Committee on Standards in establishing priorities for review and revision of 
Standards. The first study conducted by the committee as part of i .:s 
strategy is the basis for this report. 

The study was designed to address two purposes involving schoo' 
personnel associated with COEI: (1) their perceptions of the priorities for 
review/revision of COEI Standards and the importance of the Standards in 
relation to institutional quality and (2) any differences in their 
perceptions related to denographic variables describing the personnel. The 
first purpose has implications for the COEI Committee on Standards witn 
respect to the order in which the Standards should be reviewed and revised 
over a period of years. The second purpose could provide guidance on any 
demographic variables that should le considered in selecting personnel to 
participate in the review and revision process. 



Methodology 

The data utilized in this study were collected from subjects who 
attended the COEI Delegate Assembly Session at the SACS Annual Meeting ir 
Atlanta, Georgia, on December 12, 1984, Responses from a total cf 79 
subjects were used in the data analyses. An additional 27 respondents were 
excluded from the analyses because of incomplete dcta. 

The COEI Standards Committee Survey instrument was used to collect data 
tor che study. Responses were obtained on two dependent variables for each 
of the 12 COEI Standards, First, the respondent assigned a rank order of 
priority for revieu/revision to each Standard using values from 1 (highest 
priority) to 12 (lowest priority). Second, the respondeiit indicated the 
importance of each Standard in relation to institutional quality using a 
scale from i (extremely important) to 5 (relatively uninportant ), 
Descriptive information was solicited from each respondent on the following 
demographic variables: type of school represented, school accreditation 
status, position title, voting delegate status, number of COEI team member 
or team leader assignments, and number of COEI institutional self-studies in 
which involved. The responses '^n all variables were coded for computer 
analyses. 

The initial analysis of the data consisted of computing descriptive 
statistics for each demographic variable (frequency and percentage 
distributions) on each Standard. A Spearman rank order correlation 
coefficient was calculated for the rank orders of means on the review 
j>riority ranks and institutional quality importance ratings of the 
Standards. Pearson correlation coefficients were computed for the priority 
ranks and importance ratings of the Standards. 
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Inferential analyses consisting of t--tests were utilized to conpare the 
means of the review priority ranks and the quality imporcance latings or the 
Standards with their respective response scale mid-points (6.5 for the 
former and 3.0 for the latter). In addition, the one-way analysis of 
variance was applied with each dependent variable separately to compare 
subgroup means for each combination of demographic variables and Standards. 
If differences in means were detected at the .05 level of significance for 
comparisons of three or more subgroups, the 3 tudent-Newman-Keuls teclnique 
was appliid on a post hoc basis to determine the subgroup means that 
differed significantly. 



The data on respondents are summarized in Table 1. Three fifths of the 
respondents represented public occupational education institutions while one 
fourth reot3sented proprietary schools. Two thirds of the schools 
represented were accredited by COEI , one sixth were COEI candidates, -^.nd one 
tenth were accredited by other SACS commissions. Almost two thirds of the 
respondents were chief administrators of their schools and one fifth were 
professional support st^ff. Slightly more than half of the respondents were 
the voting delegates for their schools. Three tenths of the respondents had 
not served as a COEI team member while almost four fifths had not served as 
a COEI team leader. About three tenths of the respondents had served on 
five or more teams and seven tenths had participated in 1-3 COEI 
Institutional self-studies. On the first two demographic variables, the 
percentages of respondents classified by type of school and COEI 
accreditation status were similar to the population distributions on these 
variables. 



Results of Data Analyses 
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Table 1 

Suminary of Descriptive Data on Respondents 
(N=79) 

f % 

Type of School 

Public 49 62.0 

Proprietary 20 25.3 

Mi itary ^ >,b 

Private, non-profit ^ 5,1 

Accreditation Status 

COEI - accredited 53 67.1 

COEI " candidar i 14 17.7 

Other SACS commission 8 10.1 

Nc response 4 5.1 

Position 

Chief admiai£lrat-or 51 64.6 

Professional support staff 17 21.5 

Instructor 2 2.5 

Other 1 1.3 

No response 8 lu.l 

Voting Delegate 

Yes 41 51.9 

No 28 35.4 

No response 10 12,7 

Team Member Assignments 

0 24 30.4 

1 17 21.5 

2 7 8.9 

3 3 3.8 

4 5 6.3 

5 9 11.4 

6 3 3.8 

7 : 3 8 

8 11.3 

9 2 2.5 

10 or more 5 6.3 

Team Leader Assignments 

0 62 78.5 

1 5 6.3 

2 2 2.5 

3 2 2,5 
A 4 5.1 
5 or more 4 5,1 

Self-Study Participation 

0 15 19.0 

1 23 29.1 

2 18 22.8 

3 15 22.8 

4 5 6.3 

5 or more 3 3.8 



(5) 



In Table 2, the summative and irferential statistics are presented for 
the L-eview priority ranks and institutional quality importance ratings of 
the Standards, Based op a 12-polnt scale, the means for rhe priority ranks 
varied from a low of 3.01 (higher priority) to a high 8.70 (lower 
priority). The means for the importance ratings on a 5-point scale ranged 
from 1.19 (more important) to 2.47 (less important). Highest priorities a'ld 
greatest importance wer^ assJgned to Standard IV, Educational Program, and 
Standard V, Staff. Lowest priorities and least importance were perceived 
for Standard VI, Learning Resource Center(s), and Standard XII, Community 
Relations. The Spearman correlation coefficient for the rank orders of the 
two sets of means was .82 with a probability of less than .01 toi the 12 
pairs of ranks. 

The comparisons of the means for the two dependent variables with the 
respective mid-points of their response scales are also reported in Table 2. 
The review priority rank means for three Standards were sufficiently near 
the high priority end of the response scale that they differed significantly 
from the mid-point of the scale (6.5). Three additional Standards had 
priority rank means toward the low priority end of the response scale that 
differed signifi cantly from the mid~ooint of the scale. The three clusters 
of Standards could be regarded as the high, moderate, and low priority 
groups of Standards for review and revision. The comparisons of the means 
for quality importance ratings with the miJ-point of the response <=cale 
(3.0) re/ealed that the means for all Standards deviated significantly 
coward the high importance end of the scale. 

The Pearson correlation coefficients in Table 3 show the relationships 
between the review priority ranks and quality importance ratings for all 
Standaf^s based on the responses of individuals in the sample of subjects. 
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Table 2 

Summary of Data on Review Priority Ranks and Institutional 
Quality Importance Ratings by Standard 
(N=79) 



standard 



Review Priority Rank 



Quality Importance Rating 







Mean 


S.D. 


t** 


Rank* 


Mean 


S. 


0. 




i 


9 


7 


. 18 


3.26 


1 .85 


8.5 


2 . 


09 


1 . 


10 


- 7.35 


T T 

ii 




5 


.72 


3.16 


-2.19 


5 


i . 


70 


1 


10 


-25 . 24 


T T T 

III 


0 


6 


.A8 


3 .35 


. 05 


10 


2 . 


13 




91 


O C A 

- 8.50 


T\; 


1 


3 


.01 


2.83 


-10. 96 


1 


1. 


19 




60 


-26.81 


V 


2 




.82 


2.83 


- 5 . 28 


2 


1 . 


33 




67 


-22 . 15 


VI 


12 


8 


.70 


3.55 


5.51 


12 


• 


A7 


1. 


OA 


- A. 53 


VII 


5 


6 


.'^3 


3.72 


- .Al 


4 


1 . 


63 




75 


-16. 2A 


VIlI 


10 


7 


.5A 


2.66 


3. AS 


7 


2. 


0/ 




82 


-10. Al 


IX 


7 


6 


.65 


2.88 


. A6 


3 


1 . 


61 




7A 


-16.70 


X 


8 


6 


.9A 


2.82 


1.39 


8.5 


2. 


cy 


1. 


10 


- 7.35 


XI 


4 


6 


.16 


3.22 


- 1.09 


6 


1. 


78 


1. 


OC 


-10. 8A 


XII 


11 


S 


.56 


3.10 


5.91 


11 


2. 


18 


1. 


10 


- 6.63 



* Spearman correlation coefficient for ranks == .82 
t - +/- 1.99, df = 78, level of significance = .05 
.veview Priority Rank: Hypothesized mean = 6.5 
Quality Importance Rating: Hypothesized mean = 3.0 
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Table 3 

Correlation Coefficients for Review Priority Ranks and Instirutional 
Quality Importance Ratings of Standards 
(N = 79) 



00 



Quality 
Importance 
Rating by 
S tandard 



I 

II 
III 
IV 
V 

VI 

VII 

VIII 

IX 

X 

XI 

XII 



I 

. i6* 

. 19* 

.01 

. 17 

.20* 

.01 

.01 

.01 

,05 

.06 

,09 
. 16 



II 
.OA 
.2A* 
.18 
. 15 
.06 
.07 
.08 
.08 
,11 

. 16 
, lA 
,02 



III 
.13 
.01 
.30* 
.09 
-.05 
.17 
.OA 
.01 
.08 

-. 10 
-.13 
-.01 



Review Priority Rank by Standard 



IV 
.09 
.01 

.06 
.37* 
.06 
05 
,14 
.09 
,07 

.13 

,18 
,02 



V 
lA 
.03 
-.23* 
. 10 
.39* 
-.02 
-.12 
-.05 
-.OA 

.10 
.00 
-.08 



VI 
.15 
.03 
. 12 
.06 
. 11 
.08 
.20* 
.03 
,01 
.05 
.06 
.OA 



VII 
-.lA 
-.06 
•.OA 

.02 

.00 
■.20''- 

.23* 
-.05 
-.19 
-.11 
-.06 
-.05 



VIII 
-.27 
-.19* 
-.11 
-.01 
-.OA 
-.OA 
-.06 
.22* 
.15 
-.15 
-.28* 
-.2A 



IX 
.12 
. 29* 
.02 
.00 
• OA 
.02 
.02 
.0" 
,16 
,20* 
,37* 
,22 



X 

-.OA 
-.06 
-.03 
-.01 
.01 
.03 
-.11 
.12 
.02 
.A3* 
.05 
.15 



XT 
.07 
.15 
.01 
.06 
,09 
.05 
.05 
.09 
,08 
,20* 
.56* 
.09 



All 

.08 
-.09 

. lA 
-.20* 
-.38* 

.02 
-.12 

.OA 
-.OA 
-.07 

.01 
.23* 



*r = .1869, N = 79, probability = .05 
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The correlations between the priority ranks and importance ratings were 
statistically significant for 10 of the 12 Standards. Non-significant 
correlations wero revealed for Standard VI, Learning Resource Genter(s), 
which was - vised in 1984, and Standard IX, Equipment and Supplies. )nly 12 
of the remaining 132 correlation coefficients were statistically significant 
with 9 of the 12 being negatively correlated. 

Most of the significant differences in subgroup means on review 
priority ranks were revealed when the respondents were classified by type of 
school (see Table 4). For Standard II, Organization and Administration, 
proprietary school personnel assigned higher review priority than public 
school personnel. The review priority for Standard IX, Educational 
Programs, was lower for private/non-profit schc i personnel than for 
personnel representing public, military, and proprietary schools. In 
contrast, the pattern of differences for -Standard VI, Learning Resource 
Center(s), was opposite the pattern for Standard IV. Standard XI, Placement 
ana Follow-up, was assigned iii.^^^her priority by proprietary school personnel 
than military school personnel. Public school representatives gave a higher 
priority to Standard XII, Community Relations, than proprietary school 
representatives . 

The significant differences in subgroup means for quality importance 
ratings of respondents classified by type of school are reported in lable 5. 
The representatives of military schools gave higher ra :ings than the 
representatives of public, private/non-prof i . . and proprietary schools on 
t' -ee Standards: II, Organization and Administration; V, Staff; and X, 
Student Personnel Services. Lower ratings were assigned by military school 
personnel than public and proprietary school personnel on five Standards: 
I, Philosophy and Purpose of Institution; IV, Educational Programs; VII, 
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Table 4 

Summary of Results from Comparing Review Priority Ranks of Respondents 
Classified on Type of School and Accreditation Statuss 
by Stauda'-i with Significant Differences 



Standard* 

II 
IV 
VI 
XI 

XII 



Type of School 



1 vs 3 

2.69 < 7.00 
9.41 > 3,00 



1 vs 4 
6.16 > 3.85 



Paired Groups* 
2 vs 3 



3.30 < 7.00 
9.50 > 3.00 



2 vs 4 



3 vs 4 

7.00 > 2.00 
3.00 < 7.85 



.33 > 4.?5 



7.59 < 10.65 



* No signifirant differences for groups 1 vs 2 
Group 1 = Public schools 
Group 2 = Military schools 
Group 3 = Private, non-profit schorl's 
Group 4 = Proprietary schools 



Accreditation Status 



Standard 
III 



VII 



COEI candidate schools 

9.07 > 

COEI candidate schools 

9.07 > 

COEI candidate schools 

4. 14 < 



COEI accredited schools 
5.94 

Other SACS schools 
5.13 

COEI accredited schools 
6.47 



Note: Means based on rank scale of 1-12 
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Table 5 

Summary of Results from Comparing Institutional Quality Importance 
Rarings of Respondents Classified on Type of School £.nd 
Accreditation Status by Standard with 
Significant Differences 



Type of School 
Standard Paired Groups* 





1 ' 


vs 


L 


1 vs 






2 vs 


3 


2 vs 


4 


I 


1.92 


< 


3. 50 












3.50 


> 


2 . 10 


J.I 


1.61 


< 


3.00 






3 


.00 > 


2.00 


3.00 


> 


1.45 


IV 


1.10 


< 


1.83 












1.83 


> 


1.25 


V 


l.'^l 


< 


2.17 






2 


.17 > 


1.00 


2.17 


> 


1.20 


VII 


1.55 


< 


2.50 












2.50 


> 


1.60 


IX 


1.45 


< 


2.33 


















X 


1.96 


< 


3.67 






3 


.67 > 


1.75 


3.67 


> 


2.00 


XI 


1.81 




3.00 


1.81 > 


1.30 








3.00 


> 


1 .30 


XII 


1.90 


< 


3.67 












3.67 


> 


2.40 



* No significant differences for groups 1 vs 3 and 3 vs 4 
Grc p 1 = Public schools 
Gr>up 2 = Military schools 
Group 3 = Private non-nrofit schools 
Group I = Proprietary schools 



Accreditation Status 

Standard 

I COEI candidate schools COEI accredi ted schools 

2.79 > 1.92 



Note: Means based on rating scale of 1^5 
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Financial Resources; XI, Placemenc and Follow-jp; and XII, Community 
Relations. Public school representatives assigned higher ratings on 
Standard IX, Fquipment and Supplies, and lower ratings on Standard XI, 
Placement and Follow-up, than proprietary school representativps. 

Comparisons were made of subgroups formed classifying the 
respondents on each of the other demographic variables. / creditation 
status of the institution represented by the respondent was the only 
demographic variable for which differences were revealed on both dependent 
variables or more than one Standard. With regard to review priority ranks, 
COEI candidate school personnel gave lower priority tc Standard IIIj Long- 
Range Planning, than COEI accredited atxd other SACS accredited school 
representatives. On quality importance ratings, COEI accredited school 
personnel assigned greacer importance tc Standard I, Philosophy ard Purpose 
of Institution, than COEI candidate school personnel. 

Conclusions 

The purpose addressed by the study is the focus of the conclusions. 
The findings provide the basis for the conclusions that are presented below. 

Dif fere ices in perceptions are evident regarding the priorities that 
should be given to the review and revision of COEI accreditation Standards. 
The means of the ranks reveal clearly that three Standards should be given 
highest priority while three Standards should ^e given lowest priority. 
This finding Indicates that suf.x:ient agreement exists among school 
representativv-^s to use their perceptions as the basis to select clusters of 
Standards for review and revision. Since only two or three Standards can be 
addressed each year by the Committee on Standards, such information is 
important for the Committee. 
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Some d^fferances exist in the perceptions of school personnel with | 
respect to the importance rf the Standards in relation to institutional ' 
quality. However, all Standards are viewed as important indicators of 
institutional quality, '''hese perceptions suggest that the Standards are 
valid for use in the accreditation of schools by COEI. The v^lidi*:y of the 

I 

Standards supports the credibiiit> of COEI accreditation as a means of 
assuring inscitutional quality. 

The rank order relationship between the means f jr review priority ranks 
and iii'^.titutional quality importance ratings of the Standards is reasonably \ 
strong, ^t the individual Standard level, the responses on the two I 
dependent variables are related for most Standards. These results jugj^^est 
that the school representatives have similar perceptions regarding the set 
of Standards when viewed in terms of review priority and institutional 
quality importance. 

The assignment of review priority ranks by school personnel is related 
primarily to one demographic variable — type of school represented — and 
applies to less than half of the Standards. Perception? differ between 
representatives from public schools and private/non-profit and pLoprietary 
schools, military schools and private /non-prof i t and proprietary schools, 
and private/nor_-prof i t and proprietary schools. These differences should be 
consider2d in selecting representati^^es fron different types of schools to 
participate in the review and revision of specific COEI Standards. 

The quality importance ratings by school personnel differ lar;^ely for 
one demographic variable — type of school represented — as revealed for 9 of 
the 12 St;^ndards, Almost all differences indicate that importance is rated 
lower by military school personnel than public, private/non-profit, \n6 
proprietary school personnel. The external controls imposed on military 
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schools by the military organizations that operate them may account for the 
lower importance ratings assigned to selected Standards by the personnel 
representing these schools. 

The strategy used in this study offers a methodology that can be used 
by accreditation organizations to ascertain the perceptions of their 
clientele regarding evaluative standards and criteria. The results of such 
assessments can provide an objective basis for determining the sequence in 
which the review and revision of standards or criteria might be addressed. 
The study also suggests that variables on the backgrounds and institutional 
affiliation of respondents should be included in conducting the assessment 
of perceptions. 
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